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Abstract 

In this paper, we develop a semistability analysis framework for nonlinear systems with time-varying 
delays with applications to stability analysis of multiagent dynamic networks with consensus protocols 
in the presence of unknown heterogeneous time-varying delays along the communication links. We show 
that for such a nonlinear system having a continuum of equilibria, if the system asymptotically converges 
to a constant time-delay system and this new system is semistable, then the original time-varying delay 
system is semistable, provided that the delays are just bounded, not necessarily differentiable. In proving 
our results, we extend the limiting equation approach to the time-varying delay systems and also develop 
some new convergence results for functional differential equations. 

I. Introduction 

Delays are unavoidable in communication, where information has to be transmitted over a 
physical distance. Unfortunately, very little research has been done to investigate the effect of 
delays on stability of consensus of multiagent networks. To accurately describe the evolution 
of networked cooperative systems, it is necessary to include in any mathematical model of the 
system dynamics some information about the past system states. In this case, the state of the 
system at a given time involves a portion of trajectories in the space of continuous functions 
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defined on an interval of the state space, which leads to (infinite-dimensional) delay dynamical 
systems HI. 

Previously, most of the reported work has either explicitly or implicitly employed the assump- 
tion that delays are known and continuously differentiable. Under such an assumption, one can 
use the delayed state of an agent in its own local control law to match the delays of the states 
from the neighboring agents GO-lHl, i.e. agent % can use a delayed version of its own state, 
Xi(t — Tij(t)). Under that assumption, the control law is 

where Mi denotes the set of all other agents having a communication with agent i. If the delays 
are constant and uniform, = r for all ij, then the network dynamics are of the form of time- 
delayed linear systems with the system matrix being the Laplacian, x = Lx(t — r), for which 
various analysis tools for linear systems with delays can be applied 0, 0, 0. Additionally, 
the control law in (OQ) allows one to utilize disagreement dynamics, in which the disagreement 
xj(t — Tij) —Xi(t — Tij) is the delayed version of the disagreement Xj(t) — Xi(t). Because of the 
preceding property, one can study the behavior of the networks using disagreement dynamics 
or reduced disagreement dynamics in a similar fashion to the case without delays (the reduced 
disagreement dynamics are asymptotically stable). However, if the delays are unknown, time- 
varying, and not uniform over the communication links, the assumption that agent i has access 
to the delayed state Xi(t — Tij(t)) raises a practical concern. If agent i does not have Xi(t — Tij(t)) 
to use in the control protocol (in which case we say that the delays are asymmetric), the control 
law actually becomes 

iH = ^ aij{xj{t - Tij) - Xi(t)). (2) 

Because Xj(t — r^) — Xi(t) is no longer the delayed version of the disagreement Xj(t) — Xi(t), 
the derivatives of the disagreements are not functions of the disagreements only), and hence, 
the approaches in 0, 0, [0 are not applicable to networks with the protocol ©• Stability of 
dynamic networks in such a situation has only recently been addressed JH-lHl, most of which 
are limited to the case of constant time delays. In particular, the authors in have shown that 
dynamic networks with consensus protocols in the presence of heterogeneous delays are stable 
for arbitrary constant delays. Another closely related work is ifTOll . where the authors consider 
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networks with different arrival times for communication and with zero-order hold control laws, 
which leads to discrete-time dynamic networks formulation without time-delays for the overall 
closed loop. Left open is the problem of stability and convergence of time-varying consensus 
dynamic networks in the presence of unknown asymmetric non-uniform time-varying delays, 
which turns out to be a consequence of the more general results in this paper. 

In this paper, we develop a general framework for semistability analysis of nonlinear systems 
having a continuum of equilibria and time-varying delays in which the delays are unknown and 
continuous with respect to time, not necessarily continuously differentiable. Here semistability 
is the property whereby every trajectory that starts in a neighborhood of a Lyapunov stable equi- 
librium converges to a (possibly different) Lyapunov stable equilibrium. The basic assumption 
for the main result in this paper involves the idea of limiting equations ifTTI by assuming that 
the original time-varying delay system asymptotically converges to an autonomous system with 
constant delays. Using these results, next we present stability analysis of time-varying consensus 
dynamic networks in the presence of unknown asymmetric non-uniform time-varying delays. The 
main feature of the proposed framework is that the assumption on continuous differentiability 
of the time delays is considerably weakened by use of a limiting function assumption, which 
is more natural and useful in practical systems. The proposed new results can be viewed as a 
generalization of network consensus with constant time delays in 0. 

II. Mathematical Preliminaries 

Let M n denote the real Euclidean space of n-dimensional column vectors and let ||x|| denote 
the norm of the vector x in W 1 . Let r > be given and let C = C([— r, 0], W 1 ) denote the 
space of continuous functions that map the interval [— r, 0] into M n with the topology of uniform 
convergence. If x : [— r, oo) — > IR n be continuous, then for any t > 0, x t E C is defined by 
x t (s) = x(t + s), —r < s < 0. 

Consider nonlinear dynamical systems with time-varying delays given by the form 

x{t) = f(x(t)) + g{x{t - nit)), ...,x(t- r m (t))), (3) 

where x(t) E W 1 , f : M. n — > W 1 is continuous and maps closed and bounded sets into bounded 
sets, g : C — > W n is continuous and maps closed and bounded sets into bounded sets, and 
Tfc : K — > E is continuous but not necessarily differentiable, k = 1, . . . ,m. We further assume 
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that solutions depend continuously on the initial data. Define the equilibrium set of © as 8 := 

{z G MJ 1 : f(z) + g(z, . . . , z) = 0}. Given <p G C and r > 0, a function x{<p) is said to be a 
solution to © on [— r, r) with initial condition <p if <f) G C([— r, r), M n ), x t G C, a;(t) satisfies 
© for t G [0, r) and x(0)(O) = 0, where x(</>)(-) denotes the solution through (0,0). 

Throughout this paper, we make the following standing assumptions on ©. 

Assumption 2.1: S is a connected set. 

Assumption 2.2: For every k = 1, . . . , m, < Tfc(t) < /i, where /i > is a constant. 

Recall that a set E C R n is connected if every pair of open sets C M n , z = 1,2, satisfying 
£ C U1VIA2 and W;fl£ 7^ 0, i = 1, 2, has a nonempty intersection. Assumption ^, ll implies that © 
has a continuum of equilibria. In other words, the equilibria of © are not isolated equilibrium 
points. This situation occurs in many practical problems such as compartmental modeling of 
biological systems |fT2|. thermodynamic systems lfT3l . multiagent coordinated networks ||5l, 11711, 
lfl4l . and synchronization of coupled oscillators [8J. Assumption 12.21 implies that time-varying 
delays for Q are bounded. Using this assumption and the conditions on / and gk, it follows that 
© possesses a unique solution on [—h, 00) [TJ. 

Example 2.1: Consider a special case of © where f(x) = Ex, g(x, . . . , x) = J2k=i Fk%, and 
E, Fk G M. nxn are matrices, k — 1, . . . , m. If E + Ylk=i ^fe ^ s singular, then S is a connected 
set, i.e., © has a continuum of equilibria. A relevant example for this case is the consensus 
problem with time delays 0, 0, lfl4l given by the consensus protocol 



where E + 2~2T=i -^fe ^ s a Laplacian. 

Recall that a point z G IR n is a positive limit point of a solution x(t) to © with x(s) = 4>(s), 
—h < s < 0, if there exists a sequence {t n }^ =1 with t n — > +00 and x(t n ) —s-zasn—t- +00. 
The set u)(4>) of all such positive limit points is the positive limit set of xq = <p G C [1, p. 102]. 
Motivated by Lemma 2.2 of lfT5l . we have the following result. 

Lemma 2.1: Assume that the solutions of © are bounded and let x(-) be a solution of © with 
x — (f) G C. If z G cu(xo) is a Lyapunov stable equilibrium point of ©, then z = lim^oo x(t) 
and u{4>) = {z}. 

Proof: Since the solutions of © are bounded, it follows from Lemma 1.4 of Chapter 4 of 
that the positive orbit of © is precompact. Hence, it follows from Lemma 1.3 of Chapter 4 



in 




(4) 



fc=i 
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of flU that u>(4>) is nonempty. Now the proof of the result is similar to the proof of Lemma 2.2 
of lfl5l . For completeness, we include it here. ■ 
Definition 2.1: An equilibrium point x G £ is semistable if there exists an open set U C C 
containing x such that for every initial condition in U, the trajectory of © converges, that is, 
limt^oox(t) exists, and every equilibrium point in U is Lyapunov stable. The system © is 
semistable if every equilibrium point in E is semistable. 

III. Main Results 

A. General Results for Nonlinear Time Delay Systems 

In this section, we use a limiting system approach to study the asymptotic behavior of ©. 
Specifically, it follows from ([3]) that 

x(t) = f(x(t))+g(x(t-hi),...,x(t-h m )) 
+g{x{t-r 1 {t)),...,x{t-r m {t))) 

-g{x{t-h 1 ),...,x{t-h m )), (5) 

where < h k < h, k = 1, . . . ,m, are some constants that are not necessarily known. Next, 
define X(t) := g(x(t — Ti(£)), . . . , x(t — T m (t))) — g(x(t — h{), . . . , x(t — h m )). Then we have 

x(t) = f(x(t)) + g(x(t -h 1 ),...,x(t- hm)) + X(t). (6) 

Note that if x(t) = a e £, then X{t) = 0. 

Definition 3.1: If there exists V C C such that for every initial condition xq = (p EV, 

lim X(t) = 0, (7) 

then the system 

z{t) = f(z(t)) + g(z(t -h x ),...,z(t- h m )) (8) 

with the initial condition z 6 V is called a limiting system of © with respect to V. If, in 
addition, V = C, then we simply say that ([8]) is a limiting system of ©. 

Remark 3.1: The idea of the limiting equation approach was originally from (TT] and has been 
extended to various finite-dimensional dynamical systems by changing the definition of limiting 
functions |[T6ll . ifTTl . Our definition extends this approach to infinite-dimensional dynamical 
systems and gives a new definition of limiting systems for time-delay systems. 



January 12, 2010 



DRAFT 



TECHNICAL REPORT CSEL-01-10 



6 



Note that the limiting system © has the same equilibrium set as © or, equivalently, ©. 
Based on the notion of limiting systems, we have the following convergence result. 

Lemma 3.1: Consider the nonlinear system ©. Assume the trajectories of © are bounded. 
Furthermore, assume ([8]) is a limiting system of ©. Then u((p) is invariant with respect to ([8]) 
for every initial condition x = <p E C. 

Proof: Since the solutions of © are bounded, it follows that the set u(4>) is nonempty. 
Let z E u)((f)) and hence, there exists a sequence {t n }^ =1 such that t n — > oo and x(t n ) — > z 
as n — > oo. For each n = 1,2,..., define the continuous functions x n : [0, oo) — > M. n and 
/„ : [0, oo) ->■ [0, oo) as 

x n (t) := x(t + t n ), t>0, (9) 
f n (t) := \\X n (t)\\ + ^ t>0, (10) 

where 

x n{t) ■= g{x n (t - n(t)), . . .,x n (t - r m (t))) - g{x n (t - hi), . . .,x n (t - h m )). (11) 

We claim that f n is measurable. To this end, note that for each n, continuity of the map 
1 1 — y R(Dx n (t)), where R(Dx(t)) := g(x(t — hi), ... , x(t — h m )), together with compactness of 
its values ensures that for each z E W 1 ', the map t h > \\z — R(Dx n (t))\\ is measurable. Next, since 
the function t g(x n (t — Ti(t) ),..., x n (t — r m {t))) is measurable, it follows that this function 
is the pointwise limit of a sequence of simple functions (i.e., measurable functions with finite 
images). Now, it follows that /„ is the pointwise limit of a sequence of measurable functions 
and hence, is measurable. 

Note that for every e > 0, there exists N > 1 such that for every n > N, < f n (t) < e for 
all t > 0. Observe that x n (0) — > z as n — > oo. Then it follows that for all n > N, we have 

x n {t) E B fn{t) (f{x n {t)) + R{Dx n {t))) 

C B £ (f(x n (t)) + R{Qx n (t))) a.e. t > 0, (12) 

which represents a set-valued differential equation called differential inclusion in the literature 
ESI, Ifl9l , where B r (s) denotes the open ball centered at s with radius r and "a.e." denotes 
almost everywhere in the sense of Lebesgue measure. 
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Let I r denote the interval [r, r + 1]. Using (fl"2l) and by the time-delay version of Theorem 
3.1.7 of [fT8l or Lemma 4.5 of lEOl . the sequence of restricted functions {x n (t)}, t E I , has a 
subsequence {x ai r n ){t)}, t E I , converging uniformly as n — > oo to an absolutely continuous 
function x\ : J — > ~§t n , satisfying © almost everywhere and with x^(0) = z. By repeating the 
same argument, the sequence {x ai { n )(t)}, t E I\, contains a subsequence {x a2 ( n ){t)}, t E I\, 
converging uniformly as n — > oo to an absolutely continuous function x* 2 '■ I\ — > M n , satisfying 
© almost everywhere and with x^l) = By induction, there exists a nested sequence 

{ x c7i(n)}eLi of subsequences of {x n } such that for each i = 1,2,..., {x ae ( n )} converges uniformly 
on l£_i = [£ — 1,1] to an absolutely continuous function x\ : h-i — >• M n that satisfies © almost 
everywhere and with x* i+1 {i) = x}(£) and x*(0) = 

Define x* : [0, oo) -»■ W l as = for t E I t _ x . Then x*{-) satisfies ® and x*(0) = 
z. Using the Cantor diagonal argument (see, e.g., ET1 p. 210]), it follows that there exists a 
subsequence {x CTn ( n )} of {x n } converging uniformly on every interval [0,£] to x* for all t. Since 
the sequence (t CTn (n)} is such that t an ^ ->■ oo and x(t + t CT „( n )) = ^„(n)(*) ->■ as n oo, 
it follows that x*(t) E u(x ) for all t > 0, which implies that w(x ) is invariant with respect to 
®. ■ 

Lemma 3.2: Consider ([8]). If the trajectories of © converge, that is, lim^oo z t ((f)) exists for 
every <p E C, then the function : C — » C defined by f2(0) = li m t-^oo z t ((j)), G C, is an 
equilibrium point for ®. 

Proof: It follows from continuity of the solutions to © that for every s > 0, z s (f2(0)) = 
lim^oo Zt+ S (4>) = Q.{4>). Thus, fi(</>) is an equilibrium point for © and for all (j) EC. ■ 

Now we have the main result for this paper. 

Theorem 3.1: Consider the nonlinear system ©. Assume © is Lyapunov stable. Furthermore, 
assume ® is a limiting system of © and ® is semistable. Then © is semistable. 

Proof: Since by assumption, © is Lyapunov stable, it follows that the trajectories of © are 
bounded. Then by Lemma [3TTT u(4>) is invariant with respect to ®. Next, since by semistability, 
the trajectories of © converge, it follows that w(0) contains positive limit points of ©, and 
hence, u(4>) contains the positive limit set of ©. Furthermore, it follows from Lemma [3T2l that 
the positive limit set of ® contains an equilibrium point of ®. This equilibrium point is also 
an equilibrium point of © and by assumption, it is Lyapunov stable. Hence, u{4>) contains a 
Lyapunov stable equilibrium point for ©. Now it follows from Lemma 12.11 that the trajectory 
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of © converges to this Lyapunov stable equilibrium point, which implies convergence of the 
trajectories of ©. By definition, © is semistable. ■ 

Remark 3.2: To discuss semistability of © using Theorem 13. 11 one has to know the informa- 
tion on Lyapunov stability of ©. Note that here we only assume Tk{t) is continuous for every 
k = 1, . . . ,m. Hence, it is very difficult to use the Lyapunov-Krasovskii functional approach 
HI, |[22| to prove the Lyapunov stability of © since it requires the first-order derivative of 
Tk(t). In this case, the Lyapunov stability of © may be verified using Razumikhin theorems via 
Lyapunov-Razumikhin functions flTJ , E31 . Il24ll . 

Example 3.1: Consider the scalar time-delay system given by 

±(t) = -x(t)+x(t-r(t)), (13) 

where x(t) E R, r(-) is continuous, and < r(t) < h for all t E R. Consider the Lyapunov- 
Razumikhin function given by V(x) = (x — a) 2 /2, where a is an arbitrary constant. Then it 
follows from Theorem 4.1 of Chapter 5 of [1J that (fT3l) is uniformly Lyapunov stable. See HI 
p. 154] for a detailed proof. 

Remark 3.3: Suppose the trajectories of © are bounded. If ||/(x)|| < /?(■) is a 

class /C function, g(x(t - n(t)), ...,x(t- T m {t))) = J2k=i9k(x(t - T k (t))), g k (-) is globally 
Lipschitz continuous, k = l,...,m, and lim^oo r k (t) = h k for every k = l,...,m, then 
© is a limiting system of ©. To see this, suppose < M. Then from ©, < 

/3(M) + Y^ k n = i(L k M +\\g k (0)\\) := K, where L k is the Lipschitz constant, k = 1, . . . , m. Because 
x{t-T k {t))-x{t-h k ) = JlZ^ k k (t) x(s)ds, it follows that \\x(t-T k (t))-x(t-h k ) || < K\r k (t)-h k \. 
Hence, \\g k (x(t - r k (t))) - g k (x(t - h k ))\\ < L k \\x(t - r k (t)) - x(t - h k )\\ < KL k \r k (t) - h k \. 
Thus, if Hindoo r k (t) = h k , then lim^oo X(t) = 0. By definition, (fT8l) is a limiting system of 
©. 

Example 3.2: Consider the time-delay system given by (fT3l) where r(t) = h\ sin(7r/2 + 7r/(l + 
\t\))\, t E R. Clearly r(-) is continuous but not differentiable for all tel. We claim that 

z(t) = -z(t) + z{t - h) (14) 

is a limiting system of (fT3l) . To see this, note that lim^oo r(t) = h. Now it follows from 
Remark 13.31 that (fT4l) is a limiting system of (fl"3l) . 
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Next, motivated by [15], we present a Lyapunov-type result for semistability of nonlinear 
systems with constant time delays using Lyapunov-Krasovskii functionals. This result will help 
us determine the semistability of © which is required by Theorem 13.11 

Theorem 3.2: Consider the dynamical system ([8]). Assume the trajectories of ® are bounded 
and there exists a continuous functional V : C — > R such that V is defined on C and V(<f>) < 
for all G C. If every point in the largest invariant set Ai of V^ _1 (0) is a Lyapunov stable 
equilibrium point of ©, then ([8]) is semistable. 

Proof: Since every solution is bounded, it follows from the hypotheses on V that, for every 
G C, the positive limit set of © denoted by zzj(0) is nonempty and contained in the largest 
invariant subset Ai of V" -1 (0). Since every point in Ai is a Lyapunov stable equilibrium of ([8]), 
it follows from Lemma [27T1 that w((f>) contains a single point for every G C and the trajectories 
of ([8]) converge. Since f2(0) is Lyapunov stable for every G C, semistability follows. ■ 

Example 3.3: Consider the time-delay system given by (fl4"l) . Let = -2 2 (t) + / t !_ h -2 2 (s)ds. 
Then the derivative of V(-) along the trajectories of (fl4l) is given by V(z t ) = 2z(t)z(t) + 
z 2 (t) - z 2 (t - h) = -(-z(t) + z(t - h)) 2 < 0, t > 0. Note that ^(O) = {</>(•) G C : 
—0(0) + 4>{—h) = 0}. Furthermore, the largest invariant set contained in V _1 (0) is given by 
M = {<£(■) G C : 0(0) = a G R, G [-/i,0]}. Now, it follows from Example O and 
Theorem 13.21 that (fl4l) is semistable, and hence, by Example 13.11 and Theorem 13.11 (fT3l with 
r(t) = /i| sin(7r/2 + 7r/(l + |t|))| is semistable. 

As an alternative to Theorem 13 .21 we present a Lyapunov-Razumikhin function approach to 
semistability analysis of nonlinear systems with constant time delays. Motivated by 11251 . this 
result gives a different method to prove semistability of ([8]) other than Theorem 13.21 which is 
useful for many cases in that constructing a Lyapunov-Krasovskii functional for © may not be 
an easy task in these cases. 

Theorem 3.3: Consider the dynamical system ([8]). Assume the trajectories of © are bounded 
and there exists a continuous function V : C — > R such that V is defined on C and V(4>) < 
for all G C such that V ((f)(0)) = max_/ l < s < V((f>(s)). If every point in the largest invariant 
set Ai of 1Z := {0 G C : max s6 [_^ i0 ] V(z*(0)(s)) = max sg [_ fe)0 ] V(0(s)), Vt > 0} is a Lyapunov 
stable equilibrium point of ©, then ([8]) is semistable. 

Proof: Let G C be such that 2^(0) is bounded on [—h,oo). Then w((f>) is nonempty. 
Using a standard Razumikhin-type argument (see the proof of Theorem 4.1 in 03 p. 152]) and the 
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assumptions on V, it follows that the function max_^< s < V(zt(<f>)(s)) is a nonincreasing function 
of t on [0, oo). Since V is bounded from below along this solution, lirn t _ >00 {rnax_7 l <, s <o V(z t ((j)) 
(s))} exists. Hence, w(0) C M C K and z t ((f)) — > Ai as t — > oo. Finally, since every point in 
M. is a Lyapunov stable equilibrium point of ©, it follows from Lemma [2TT1 that the trajectories 
of © converge. Thus, by definition, © is semistable. ■ 
Example 3.4: Consider the scalar time-delay system given by 

x(t) = -mx(t) + ^2x(t-T k (t)), (15) 

k=l 

where x(t) G R and r fc (t) = (hk/m) \ sin(7r/2 + 7r/(l + |t|))| for every fc = 1, . . . , m, t G R. 
Using the Lyapunov-Razumikhin function V(a?) — (x — a) 2 / 2 and similar arguments as in (TJ 
p. 154], it follows that (fl"5l) is uniformly Lyapunov stable. Next, note that 

m 

z(t) = -mz(t) + ^z(t-/iA;/m) ( 16 ) 
fc=i 

is a limiting system of (fT3T>. We show that (fT6l) is semistable. To see this, note that for V(z) = 
(z - a) 2 /2, a G R, we have 

m 

V(z(t)) = -mz 2 {t) + ^2z(t)z(t - hk/m) 

k=i 

m 

< -mz 2 (t) + ^2\z(t)\\z(t- hk/m)\ 

k=l 

m 

< -mz 2 (t) + ^z 2 (t) = (17) 

k=l 

if \z(t+6)\ < \z(t) \ for 9 G [-h, 0]. Hence, it follows from Theorem 4.1 of [HI p. 152] that Q5) is 
Lyapunov stable. Next, we want to compute 7£ and .M. First of all, note that M. is nonempty since 
G M. Let G 1Z, that is, let G C be such that max_ A <d< |z f (0)(0)| = max_k<0<o \4>(9)\ 
for all t > 0. For G K satisfying |0(O)| > |0(s)|, s G [-/i,0], there exists t* > for 
which V^(z t *(0)) = as attains a relative maximum for such f\ For such a £*, —mz 2 (t*) + 
££=i *(**)*(** - ^/™) = 0, and hence, z(i*) = or -mz(t*) + £™ =1 z(t* - /iJfe/m) = 0. 
Consider the case where 0(0) > 0. Then it follows that z{t* + 9) < z{t*) for all 9 G [-/i,0]. 
Therefore, z(t*) = or z(t*) = z(t* — hk/m) for every k = 1, . . . , m. Due to uniqueness of 
solutions, we have = or Zt(4>) = z t (4>)(—kh/m) for every k — 1, . . . ,m and all t > t*. 
By Example [331 it follows that X = {<£(■) G C : 0(0) = a G R, 9 G [-/i,0]}. Now, it follows 
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from Theorem 13.31 that (fT6l) is semistable. Finally, it follows from Theorem 13.11 that (fl"5l ) is 
semistable. 

B. Specialization to the Consensus Problem 

Lemma 3.3: Consider the dynamical system ©. Assume the trajectories of © are bounded. 

If lim^oo Tfc(t) = h k for every k — 1, . . . , m, then 

m 

z(t) = £z(t) + (18) 
fe=i 

is a limiting system of ©. 

Proof: The proof is essentially given by Remark 13.31 For completeness, we include it 
here. Suppose \\x{t)\\ < M. Then from ©, ||±(t)|| < \\E\\M + Y!k=i \\ F k\\ M ■= K - Because 
x(t-T k (t))-x(t-h k ) = //r^ (t) x(s)ds, it follows that \\x(t-T k (t))-x(t-h k ) \\ < K\r k {t)-h k \. 
Thus, if lim^oo r k (t) = h k , then \im t ^ l . OQ X{t) = 0. By definition, (fT8l is a limiting system of 

©• ■ 

Next, we present a Lyapunov stability result for ©. Define F := Y^k=\Fk- For a matrix 
A e M mxn , we use A^ to denote the (i, j)th element of A. 

Lemma 3.4: Consider the dynamical system © having the following structure: all the ele- 
ments in F k are nonnegative, k — 1, . . . , m, 

Ufa = { ~^ at " ( i9) 

0, z = ?', 

dij > 0, z, j = 1, . . . , n. Then © is Lyapunov stable. 

Proof: Note that under the assumptions in Lemma l3~4l © can be rewritten as 

m n m n 

= ~ Y Y FHhiMt) + Y Y F KiJ) z 5^ - Tfc W) 
fe=l j=l fc=l j=l 

m n 

fc=i j=i 

where i^ij) > for all k — 1, . . . , m and i, j = 1, . . . , n. 
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Consider the Lyapunov-Razumikhin function given by 

y(0) = ^max{(0 i -«) 2 }, (22) 

Z \<i<n 

where a E E. To use Razumikhin theorems ( (HI p. 151]) showing Lyapunov stability, we focus 
on V(4>(0)) = max_ fe < s < V((j)(s)), that is, for the cases in which 

(0,(0) - a) 2 > (^(8) - a) 2 , s E [-h,0], (23) 

where I is the index for which |0/ — a\ = maxi<K„ |0j — a\. 

The derivative of V along the trajectories of © is given by V(<p) = (0/(0) — a) 0/(0). First 
suppose 0/(0)— a = c > 0. Then it follows from (1231) that — c < (j)j(s)— a < c for all j = 1, . . . , n 
and s E [—h, 0]. This implies that 4>j(s) —0/(0) < for all j — 1, . . . , n and s E [—h, 0]. Hence, 
by <[2D, it follows that 0/(0) < 0. Similarly, one can show that if 0/(0) - a < 0, then 0/(0) > 0. 
In summary, V((f)) < 0. Now it follows from Theorem 4.1 of [1, p. 152] that © is Lyapunov 
stable. ■ 

The following corollary regarding semistability of time-varying delay network consensus 
protocols given by © follows directly from Lemmas 13.31 and 13.41 Theorem 13 . 1 1 and a result 
from [7]. To state this result, define 1 = [1, . . . , 1] T E R n . 

Corollary 3.1: Consider the dynamical system © having the structure given by (fT9l ) and (|20l . 
Assume lim t _^ 00 r fc (t) = h k for every k = 1, . . . ,m. Furthermore, assume that (E + F) T 1 = 
(E + F)l = and rank(E + F) = n — 1. Then for every a E M, al is a semistable equilibrium 
point of ©. Furthermore, x(t) — > a*l as t — > oo, where 

. _ 1 T< K Q ) + ZX=i l T F k (fi(9)d9 

Proof: First, it follows from Lemma [331 that 



x(t) = Exit) + F k x (t ~ h k) (25) 

k=l 

is a limiting system of ©. Next, it follows from Theorem 3.1 of that (|25T) is semistable. 
Now, it follows from Lemma 13.41 and Theorem 13.11 that © is semistable. The expression d24l) 
for a* follows from Theorem 3.1 of 0. ■ 
Example 3.5: Consider the time-delay system given by 

xi(t) = -x 1 (t) + x 2 (t-r 1 (t)), (26) 

x 2 (t) = - X2 (t)+ Xl (t-T 2 (t)), (27) 
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where n(*) = /ii|tsin(l/t)| for t ^ and n(t) = h t for t = 0, and r 2 {t) = h 2 (l - e" 1 ' 1 ). 
Clearly in this case, 



-1 




1 

















-1 









1 



Now it follows from Corollary 13. II that the time-delay system given by (T26l) and (1271) is semistable. 

Next, we generalize Corollary 13.11 to the nonlinear system given by 

in 

x(t) = f(x(t)) + Y,9k(x(t - r fc (t))), (28) 
fc=i 

where / = . . . , f q ] T . Using some result from 0, we have the following stability result for 
the nonlinear network consensus with time-varying delays given by the form of (l28l) . Recall 
that for a diagonal matrix A G M nxn , the Drazin inverse A D G IR nxn is given by AS « =0 if 
A (M) = and A° = 1/A (M) if A (M) ^ 0, z = 1, . . . , n M P- 227]. 

Corollary 3.2: Consider the dynamical system (1281) where /(0) = 0, gk(0) = 0, /c = 1, . . . , m, 
and fi(-) is strictly decreasing for fa ^ 0, i — 1, . . . , n. Assume ((281) is Lyapunov stable and 
lim^oo Tfe(t) = /ifc for every k — 1, . . . , m. Next, assume that l T (/(x) + 2~2k=i 9k( x )) — for 
all x G M 71 and /(x) + Ylh=i9k{ x ) = if and only if x = cl for some c G R. Furthermore, 
assume that there exist nonnegative diagonal matrices P& G M nxn , k = l,...,m, such that 
P := Ylk=i Fk > 0, P^Pkgk{x) = 9k{%) f° r every x G IR n and k — 1, . . . , m, and 

^^ T (a:)P^ fc (x) < / T (a:)P/(x), iGl", (29) 
fc=i 

m 

^/ T (x)PP fc D P/(x) < / T (x)P/(x), xef. (30) 
fc=l 

Then for every a G 1, al is a semistable equilibrium point of d28l) . Furthermore, a;(t) — >■ a*l 
as £ — > oo, where a* satisfies 

m m „Q 

na* + ^ /i fc l T ^(«*l) = 1 T 0(O) + J2 / l T ^(0(^))d^. (31) 

fc=i fc=i 

Proof: First, it follows from Lemma 13.31 that 

m 

z(t) = /(z(t)) + ^ <fc(z(t - fc fc )) (32) 
fc=i 
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is a limiting system of (|28l ). Next, it follows from Theorem 4.1 of that (1321) is semistable. Now, 
it follows from Theorem 13.11 that (1281) is semistable. The equation (l3TT) follows from Theorem 
4.1 of Q. ■ 

Example 3.6: Consider the time-delay system given by 

ii(t) = -x?(t) + x|(t-ri(t)), (33) 
x 2 (t) = -xi(t)+x?(*-T 2 (*)), (34) 
where n(t) = hi — h\e~^ sint and r 2 (t) = h 2 — /i 2 sin(l/(l + |t|)). In this case, 



/(*) 







x 2 


5 


9x(?) = 


, y» 3 




, 92(x) = 




x\ 


Pl = 




1 



, ^2 = 



1 


, P = 


1 
1 



Now it follows from Corollary 13 .21 that the time-delay system given by (1331) and (l34l) is semistable. 

IV. Conclusion 

A new framework concerning semistability of nonlinear systems having a continuum of equi- 
libria and time-varying delays is presented and its applications to stability analysis of multiagent 
dynamic networks with consensus protocol in the presence of unknown heterogeneous time- 
varying delays are discussed in this paper. Those time delays are not necessarily differentiable 
and known. We provided conditions, in terms of the limiting system, to guarantee semistability 
of nonlinear systems with multiple time- varying delays and applied those stability results to show 
that multiagent dynamic networks can still achieve consensus in the presence of heterogeneous 
delays, provided that the delays converge to a limit asymptotically. 
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